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Two approaches to studying the correlation functions of the binary Markov sequences are con- 
sidered. The first of them is based on the study of probability of occurring different "words" in 
the sequence. The other one uses recurrence relations for correlation functions. These methods are 
applied for two important particular classes of the Markov chains. These classes include the Markov 
chains with permutative conditional probability functions and the additive Markov chains with the 
small memory functions. The exciting property of the self-similarity (discovered in Phys. Rev. Lett. 
90, 110601 (2003) for the additive Markov chain with the step- wise memory function) is proved to 
be the intrinsic property of any permutative Markov chain. Applicability of the correlation functions 
of the additive Markov chains with the small memory functions to calculating the thermodynamic 
characteristics of the classical Ising spin chain with long-range interaction is discussed. 
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I. INTRODUCTION 

The problem of long-range correlated random symbolic systems (LRCS) has been under study for a long time in 
many areas of contemporary physics 0, 0, IE Q IE El > biology 0, IE H 13 CGI 03 , economics 0, Q , linguistics 0, 
flfl IrH ITsl llflj. etc. Among the ways to get a correct insight into the nature of correlations of complex dynamic 
systems, the use of the multi-step Markov chains is of great importance because it enables constructing a random 
sequence with the prescribed correlated properties in the most natural way [iJJ, |2fl |21| . Also the additive Markov 
chains with small memory functions are of interest for the non-extensive thermodynamics of Ising spin chains [2^.l2^ |. 

The multi-step binary Markov chain is characterized by the conditional probability of the defined symbol ai (for 
example, = 1) occurring after previous symbols within the memory length N, i.e., after AT-word. We define the 
.L-word Tl, or the word of length L, as the set of L sequential symbols. The Markov chain can be easily constructed by 
the sequential generation of symbols using the prescribed conditional probability function. The conditional probability 
points to the direct association between the symbols. At the same time, the correlation functions describe the implicit 
interaction between the symbols. Correlation functions of all orders determine completely every statistical property 
of any random sequence. So, the problem of finding the correlation functions of high orders is essential. The aim of 
the paper is to find the correlation functions of different orders of the binary Markov chain using two approaches and 
to examine their properties. 

The paper is organized as follows. The second Section describes the method of calculating statistical characteristics 
of the Markov chain via the conditional probability function. Here the property of the self-similarity of the correlated 
random sequences is also discussed. The third Section is devoted to a method for finding the correlation functions 
using recurrence relations for them. The applications of the proposed general algorithms to some concrete classes of 
chains are presented. 

II. DIRECT METHOD FOR CALCULATING STATISTICAL CHARACTERISTICS OF THE 

MARKOV CHAIN 

In this section, we describe a direct method of finding following characteristics of the iV-steps Markov chains: the 
probability P{Tn) of the A^-words occurring, the probability P{Tl) of occurring the words of an arbitrary length L, 
and the high-order correlation functions. 
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It is known that all statistical properties of Markov sequence are determined completely by the conditional proba- 
bility function. Along with this function, it is convenient to employ the probabilities P(Tn) of the TV-words occurring. 
All other characteristics of the chain can be found using these probabilities. Though the calculation of P(Tn) is 
quite a challenge in the general case, we succeed in obtaining the analytical results for some particular cases (see 
Subsec.HEJ. 

The N-step Markov chain is a sequence of random symbols c^, i G Z = {. . . , —2,-1, 0, 1, 2, . . . }. It possesses the 
following property: the probability of symbol a* to have a certain value, under the condition that the values of all 
previous symbols are given, depends on the values of TV previous symbols only, 

P(cn = a\ . . . , di-2, o»-i) = P(flj = a\a^ N , . . . , 0,-2, Oi-i). (1) 

We refer to TV as the memory depth. 

In this paper we consider binary chains only, but some results can be generalized to non-binary sequences as well. 

A. Probabilities of the TV-words occurring 

We start examining the statistical properties of the Markov chains with searching the probabilities of the iV-words 
occurring. There are 2 N different A-words in the arbitrary Markov chain which is characterized by 2^ probabilities 
of these words occurring. They can be found using evident formulas of the probability theory, 

P(A) = P{AnB) + P{AnB), (2) 
P{AC\B) =P{A\B)P{B). (3) 

Here An B means that events A and B occur simultaneously and event B is opposite to the event B. Eqs. (pj) 
yield the following equation, 

P(a 1 a 2 . . .a N ) = ^ P(a N \aai . . . aN-i)P(aa! . . . a N -%). (4) 
a=0,l 

This equation, being written for all possible values of symbols oi, . . . , ajv, along with the normalization requirement, 

P{a\a 2 ■ ■ .on) = h (5) 

a. i= 0,l 

i=l,...,W 

is in fact the set of linear equations. From this set, one can obtain all sought probabilities P(Tn). Though set <@J, © 
contains 2^ + 1 equations, it has a single solution because one of Eqs. Q is a linear combination of others. 



B. Probabilities of arbitrary words occurring and correlation functions 

Using Eq. l|2j we can calculate the probability P{Tl) with L < N by reducing the TV- words to the L-word 
(axa 2 ■ ■ - a s ), 

P{a\a2 ■ ■ .Oi) = ^2 P(a 1 a 2 ■ ■ -a N ), L < N. (6) 

o 4 =0,l 
i = L + \,...,N 

This equation represents the probability of the L-word occurring as the average of the probabilities to have the 
TV-word containing this L-word. It is possible to reduce the A-word to the shorter L-word by summing over different 
sets of symbols at the left and right edges of the TV-word. 

The word of length L greater than TV can be presented as the combination of the word of length TV and (L — TV) 
symbols following after it. According to the definition of the Markov chain, each of these (L — TV) symbols can take 
on a certain value with the probability depending on the precedent A-word. The (L — TV)-fold use of Eq. 10 yields 
the following equation, 

L — N 

P(aia 2 ...o:l) = P{a\a 2 . . . a N ) P(a N+r \a r a r+1 . . . ajv+r-i), L > N. (7) 

r=l 



3 



Let us define a correlation function of the sth order: 



K s (i 1 ,i 2 , ...,i s ) = (a n - a i:1 )(a i2 - a l2 ) . . . (a lB - a is ), (8) 

where ~ is the statistical average over the ensemble of chains. We consider ergodic chain. According to the Markov 
theorem (see, e.g., Ref. jj2l|)> this property is valid for the homogenous Markov chains if the conditional probability 
does not take on values and 1. In this case averaging over the ensemble of chains and over the chain coincide. 

Formally, function K s depends on s arguments (s different indexes of the symbols), but we do consider homogenous 
Markov chains. Therefore, correlation function K s depends on (s— 1) arguments, i.e., the distances between the indexes, 
r\ = i 2 — ii,r 2 = ij, — i 2 , ■ ■ ■ ,r s -i = i s — i s -i- Its definition is written as 



K s (r 1 ,r 2 , ■ ■ . , r s _i) = (a - a)(a ri - a)(a ri+r2 - a) . . . (a ri+ ... +ra _ 1 - a). (9) 
Here a is the average number of unities in the sequence and notation 7TT is the statistical average over the chain, 
1 M 

rii • • • i a ri + ...+r„) — IhXL 777~r~~T / , f{ a i+ri 1 ■ ■ ■ , ai+ ri + ...+r B )■ (10) 

i=— M 

Introducing the notation, 

k 

Rq = 0, i? fe = ^ri, di^cit-a, (11) 

i=l 

we rewrite definition 10 of the correlation function, 

K s (r 1 ,r 2 , ■ ■ ■ ,r s -i) = ^2 d Ro d Ri ■ ■ - d R s -iP( a Ro a Ri ■ ■ - a R s -i)- (12) 

a R . =0,1 
«=0 *-l 

Now we can complement the set of symbols a,R , , . . . , <ir s _ 1 with the symbols between them. Finally we have 
the following formula, 

K s (ri,r 2 , ■ ■ • = ^ d Ro d Rl . . . d Rs _ 1 P{a a 1 . . . a Rs _J. (13) 

ai=0,l 
i=0,...,R a _ 1 

Here probabilities P{aoa\ . . . a Rs _ 1 ) should be calculated using Eqs. © or 0. 

C. Permutative Markov chains 

Solving linear system <@J, © for the general case is a challenging problem. Here we demonstrate the application of 
the described method to a certain class of the Markov chains. We assume that the conditional probability function 
of the chain under consideration is independent of the order of symbols in the previous iV-word. We refer to such 
sequences as the permutative Markov chains. 

1. Probabilities of word occurring in the permutative Markov chain 

It is convenient to introduce a new abbreviated notation for the conditional probability function 

P(flN+i \a\a 2 ■ ■ ■ ajv) = Pk(a<N+i)- Here k = a\ + a 2 + . . . + ajv is the number of unities in TV-word (a\a 2 . . . ajv)- 
Besides, we define Pfc(l) as pk- 

Now we seek the solution of system <@J, © in the form 

bjv(fc) = b N (ai + a 2 + . . . + a N ) = P{a\a 2 . . . a N ). (14) 

In other words, the probability of the TV-word occurring depends on the number of unities in this iV-word only. Then 
Eq. Q can be rewritten as the following recurrence relation, 

b N (k) = p k -ib N {k - 1) + p k b N (k). (15) 
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The solution of this equation is 



b N (k)=b N (0)T[^-. (16) 

r=l Pr 

Here probability 6/v(0) can be obtained from Eq. 

iV fc 

Mo)=(E^n^)"» 

l — n 1 



fc = n\ = T(n+1) 

™ fe!(n-fe)! r(fc + l)r(n - k + 1) ' 

The probability P(a\a2 ■ ■ ■ cln), Eq. itTHl . does not depend on the order of symbols in TV-word (aid2 . . . a^). From 
Eq. and the above statement it follows that the probability P{Tl) of a short word (with L < N) occurring is 
likewise independent of the order of symbols in this word. Denoting this probability by 6l(^) = &L(ai+ct2 + - ■ = 
P(aici2 . . . Ul) we arrived at the following formula, 

N-L 

b L (k)=Y. C N~LbN{k + m). (18) 

m=0 

The probability of the long L-word (with L > N) occurring does depend on the order of the symbols in this word. 
Using Eq. JJJ we have 

L-N 

P(aia 2 .-.a L ) = b N {q ) p qr ,_ 1 (a N+r ). (19) 

r=l 

Here qi = a^+i + + . . . + cii+N- Equations l(Tfijl - ltT8|l are the generalization of results earlier obtained in (ill 
for the additive binary Markov chain with the step-wise memory function. 



2. Correlation functions 



Here we present analytical results from the calculation of the correlation functions of arguments n, . . . , r s _i satis- 
fying the condition r\ + . . . + r s -i < N. For this purpose we express the fraction of unities in the chain using Eq. I|18ll , 

N 

a = 6i(l) = ^Mfc)4: 1 1 . (20) 
fc=i 

For the permutative Markov chains under consideration, the correlation function of arguments n, . . . ,r s -i depends 
on their number s only. Equation l(T3jl yields 

JV 

K a (n,r2, ■ ■ ■ ,r 3 -i) = K s = y b N (k)SN(k, s,a), (21) 

fc=0 



min{s,/c} 

S N (k,s,a)= £ (-ay-iCfcJjCi. (22) 

In particular, the binary correlation function 1^2 (f) of any permutative chain is constant for the values of arguments 
less than the memory depth: K2 (r) = K2, r < N. 

If we apply all derived formulas to the additive Markov chain with the step-wise memory function, 

1 /2fc \ 

Pfe= 2-^ + ^(^- 1 )' ( 23 ) 
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we get the correlation functions of order s, 



r(m +n 2 ) ^s- fc ^ fc r(m + k) 

S = ^i^rh S nn,+n 2 + kY (24) 



- "i JV(1 - 2(/i + 1/)) 7V(1-2( M -^)) 

o= : , «i = 1 . "2 = -: • 25 

ni + n 2 4/x 4^ 



Here 



For s = 2 we recover the results previously obtained in |2lL [25j for the binary correlation function K 2 . 

D. Self-similarity of the permutative Markov chain 

In this subsection we point out an interesting property of the permutative Markov chains, namely, their self- 
similarity. The discussion of this issue for the step-like memory function is presented in paper [25]. 

Let us reduce the TV-step Markov sequence by regularly (or randomly) removing some symbols and introduce the 
decimation parameter A = N*/N, 1/TV < A < 1, which represents the fraction of symbols kept in the chain. 

Due to approachment of symbols in the sequence after the decimation procedure, the binary correlation function 
K 2 (r) transforms into 

{(1 - {r/\})K 2 ([r/X}) + {r/X}K 2 ([r/X\ + 1), regular decimation, 
§ K 2 (r + l)C l l+r _ x {l - A)*A r , random decimation, ^ 

where [x] is the maximal integer number less than x and {x} — x — [x]. 

The correlation function K 2 (r) of the permutative Markov chain is equal to constant value K 2 with arguments 
r ^ N — 1. According to Eq. (regular decimation), the values of the correlation function K 2 (r) at r ^ A (TV — 1) 
take on the same value K 2 . In the case of the random decimation we have only an exponentially small (at N >■ 1) 
difference between the correlation function K 2 {r) and value K 2 , 

A - 

\K$(r)-K 2 \^-==exp(-a(\,\)N), r = ATV, A < A. (27) 



'XN 

Here the new function a(A, A) and constant A are introduced, 

a(A,A) =Aln(~) + (1 - A) hi > 0, A = -j=(\K 2 \+vnx\K 2 (r)\). (28) 

Thus, the correlation function of the decimated sequence is constant (or asymptotically constant) at the region 
r < N* . This property is referred to as the self- similarity. 

The self-similarity is the intrinsic property of the permutative Markov chains. It is possible to show that, in the 
general case, the conditional probability function of the decimated iV-step Markov sequence is of infinite memory 
depth. This is because its conditional probability is "blurred" by the decimation procedure and becomes dependent 
on all previous symbols. 

So, the self-similarity is the property of the binary correlation function only and inheres in all random sequences 
with a constant binary correlation function K 2 (r) at r < TV, 

K 2 (r) = K 2 , 1 < r < TV => Self-similarity. (29) 



III. CORRELATION FUNCTIONS AND CHARACTERISTIC EQUATIONS 

In this Section, we deal with the recurrence relations to find the correlation functions. In Subsection A we show that 
these relations yield the explicit expression for the correlation functions via the roots of the characteristic equations. 
Subsection B is devoted to applications of this method. The last Subsection contains some generalizations of the 
above-mentioned recurrence relations. 

The procedure of finding the correlation functions K s is based on the mathematical induction method. In other 
words, we suppose that all correlation functions K t of the orders less than s are found. For the convenience sake, we 
admit that Kq = 1 and K\ = 0. 
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A. High-order correlation functions of the additive Markov chain 

Consider the TV-step Markov chain with the additive conditional probability function, 

JV 

P(ai = l\a,i-N ...Oi-i) = a + F(r)(ai- r ~ a). (30) 

r=i 

Here function F(r), r = 1, . . -jJV, is referred to as the memory function and a is the fraction of unities in the above 
sequence (for details see Ref. (23). 

Let us find the recurrence relations for the correlation functions of TV-step additive Markov chain. For this purpose, 
we first calculate explicitly the average over symbol a ri +...+ rs _ 1 in Eq. QJ. Using the notation of Sec. Ill Bl and Eq. (|30ll . 
and taking into account equation P(aR s _ 1 = 1|-) + P(o.r,_ 1 = 0|-) = 1, we can rewrite Eq. © for arbitrary n > 0, 
i = 1, . . . ,a — 1, in the form, 

(flflo - a) • • • (ajj,_i - a) = 



= (o - a) . . . (a fls _ 2 - a)((l - a)P(a Rs _ 1 = llT^ij^J - aP(a Rs _ 1 = OlT^^J) = (31) 



= (o - a) . . . (or s _ 2 - a) 2J F(r)(a Rs _ 1 ^ r - a). 

r=l 

Here Tjv,fl s _ 1 is the set of symbols (a^ s l _jv, ■ • • , <zr s _i-i). In that way, we obtain the fundamental recurrence relation 
connecting the correlation functions of different orders s, 

JV 

K s ( n ,..., r s _i) = ^ F(r)tf,(n, ■ ■ ■ , r s _i - r). (32) 

r=l 

In the particular case s = 2, this equation, 

JV 

K 2 (r 1 )=Y,F(r)K 2 {r 1 -r), (33) 
r=l 

was obtained and discussed in [2IJ]. Recurrence relation ll32ll is correct for r% > Q, i = 1, . . . , s — 1. Provided that 
r s _i ^ TV, the last argument of the correlation function in the right-hand side of Eq. i.Vll) is negative or zero and one 
should interpret it in the following manner, which is referred to as "collating". If the correlation function has negative 
arguments, we must reorganize it according to definition ©. For example, 

K 4 (2, 2, -3) = ((oq - a)(a 2 - a)(a 4 - a)(a\ - a)) = 



= <(a - o)(oi - a)(a 2 - a)(a 4 - a)) = K 4 (l, 1, 2). (34) 

If the correlation function has zero arguments (indexes i and k of two multipliers (a, — a) and (ojfe — a) coincide) one 
should employ the property of the binary chain: af = di, a,i = {0, 1}. Thus, we have 

(fli — a) 2 = (1 — 2a)(flj — a) + a(l — a). 

With this property we can write the useful relations for the correlation function containing zero arguments in 
different positions among all arguments of K s , 

-ZV s (0,r 2 , . . . ,r g _i) = (1 - 2a)K s - 1 (r 2 , . . . ,r s _i) + a(l - a)7V ;5 _2(?'3, ■ ■ • j^s-i), 
K s (n, . . . ,r fe _i,0, rfc+i, . . . ,r s _i) = (1 - 2a)7V s _i(ri, . . . ,r k -i,r k +i, ■ ■ .,r s _i)+ 

+a(l - a)if s _ 2 (ri, . . . ,r k -i + r k+1 , . . . ,r s ), kj^l,s, 
K s (rx, . . . ,r s _ 2 ,0) = (1 - 2a)if s _i(n, . . . ,r s _ 2 ) + a(l - a)i^ s _ 2 (ri, . . . ,r s _ 3 ). 
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The general solution of Eq. I.'t2t can be represented as a linear combination, 

AT 

K s (r 1 ,...,r s - 1 ) = Y,L j (ri,-.-,r s - 2 )f/- 1 , n > (i = 1, . . . , s - 1), (36) 
i=i 

of powers of the roots £j, j = 1, . . . , N, of the characteristic equation, 

JV 

j'=i 

New functions Lj(ri, . . . ,r s _2), i.e. coefficients of linear form Eq. l-'Uill . in their turn, should be defined. All one has 
to do is to substitute Eq. ll-ifill into "collated" Eq. l.'>2ll for < r s _i < N. Finally, this procedure yields the recurrence 
relations for the sought functions Lj . 

The general solution of this recurrence relation is reduced to the form, 

N(N-l)/2 

Li(ri,...,r a _ 2 )= Mikin,...,^)^- 2 , (38) 

k=l 

where r]k, k = 1, . . . , N(N — l)/2, are the roots of the new characteristic equation 

detT(? 7 )=0, (39) 



Ti J (r/) = (r ? /0r 1 -^- 1 + «5ii, >.j 1 V. (40) 

From the "collating" procedure we can find the next recurrence relations for functions My etc. Using this algorithm 
we can find, in principle, the correlation functions of all orders. 



B. Application of the algorithm 

All results obtained in this subsection are correct for the additive Markov chain, but some of them are valid for 
the non-additive chain as well. 

The first simple result is that the correlation functions of all odd orders are zero for the additive Markov chain with 
a — 1/2. This results from Eq. 13511 ; function i^m+iO) is expressed only in term of i^m-iG) and K\ = 0. 

The correlation function of the second order -K^O) (the binary correlation function) for an additive Markov chain 
can be found from Eq. l(32|l : 

N 

K 2 (r) = J2 L ^h r >~ N > ( 41 ) 
i=i 

where £j, j — 1,...,N, are the roots of the characteristic equation 113 711 . Coefficients Lj should be obtained by the 
collating: 

K 2 (0) = a(l-a); K 2 (-r) = K 2 {r), < r < N. (42) 

Paper [ijj contains an analysis of this equations in the case of the additive Markov chain with the step- wise memory 
function. Below we present the results of calculation for the correlation function of a weakly correlated chain, 

\P(a,i = l\ai- N ...a 4 _i) - a\ < 1. (43) 

This case is very important from the physical point of view because the statistical properties of the equilibrium long- 
range correlated Ising chains can be represented and considered as the Markov chains. Specifically, the Markov chain 
with the small memory function is statistically equivalent to the weakly correlated Ising chain (see Refs. H2,[2j|). 
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For the correlation function of even order of the unbiased (a = 1/2) additive chain we have 

%)«^(r), 0<r<iV, K(0) = j, (44) 

5 

K 2s {r 1 ,...,r 2s ^ 1 ) = Y[K 2 {r 2 ^ 1 ), Tj > 0, j = 1, . . . , 2s - 1. (45) 
j'=i 

The latter equation is correct for the non-additive sequence as well. In the case of one-step Markov chain, N = 1, 
this equation is exact. But if N > 1 one should interpret it as the asymptotical equality. At N = 2, the exact result 
for the correlation function K±{-) of the additive chain is, 

K 4 ( ri ,r 2 ,r 3 ) = K 2 ( ri )K 2 (r 3 ) + (-66P (jK 2 (n +r 3 ) - K^K^r^ . (46) 

Here £ 1 and £2 are the roots of the characteristic equation, 

£ 2 -F(l)£-F(2) =0. (47) 

And finally, Eq. (l32l) allows us to express the memory function in terms the prescribed correlation functions K s . In 
Ref. [13] , the method of constructing the correlated binary sequence with prescribed binary correlation function K 2 
was earlier discussed. 



C. Generalized algorithm of finding the correlation functions 

Here we generalize the algorithm proposed in Suhsec. llII Al for the additive Markov chains to the arbitrary binary 
multi-step Markov chains. 

The conditional probability function of the A^-step binary Markov chain can be written as 

N 

P(ai = l\ai- N ...ai-i) = F ( z i^2, ■ ■ ■ Jn) Y[(di- r - a) lr . (48) 

13=0,1 r=l 

j=l,...,N 

It is a general form for the arbitrary binary function, because P(-\-) can be thought of a linear function of each 
argument ay. We refer to function F(h, h, ■ ■ • , In) as the generalized memory function. 
Equation i|48ll can be applied to the additive Markov chain described by Eq. 1-tOII . namely, 

F(0,0,...,0) = a, 

F(0 11 ^ 2 0,l,0,...,0) = F(r), r = l t 2,...,N, (49) 

1 — 1 N—r 

F(h,h, ...,l N ) = 0, h + h + ■ ■ ■ + In > 1. 

Now we obtain the recurrence relation for the correlation function with the coefficients expressed via the generalized 
memory function, according to the procedure performed in Suhsection lHI Al we substitute the last symbol a ri+ ... +rs _ 1 
in Eq. 10 (for r,- > 0, j = 1, . . . , s — 1) for its conditional probability P(-\-) in the form of Eq. As a result one 
gets, 

K s {n,...,r s -i) = ( J F 1 (0,0,...,0)-a)K s -i(ri,...,r s _ 2 )+ (50) 
+ F{h,h, ■ ■ ■ ,lN)K a +k-i(ri, ■ ■ ■ ,r a -2,r 8 -\ - Pk,Pk - Pk-i, ■•■,Pi - pi), 

Zj=0,l 
j=l,...,N 

where k = l\ + . . . + Zjv 7^ 0. The increasing numbers pj, j = 1, . . . , k are the indexes, for which l p . 7^ 0. 

Note that some summands in Eq. l|50"j) can have non-positive arguments if r s ~i ^ N. For this case, one should 
apply the "collating" procedure to this equation. 

Thus, the algorithm for finding of the correlation functions can be formulated as follows: 

1. To obtain the correlation function K s (ri,r 2l . . . ,r s _i) at > 0, i = 1, 2, . . . , s — 1, we should use Eq. l|50j) 
and execute the "collating" procedure. We find that function K s (ri,. .. ,r s _ 1 ) is expressed via the correlation 
functions with the sum of their arguments less than initial sum r\ + . . . + r s -i- 
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2. Using Eq. and performing the "collating" procedure m times with respect to the obtained correlation 
functions, we derive a relation between function K s (rx, . . . , r s -%) and some other correlation functions. 

(a) If all of them have the order less than s, we obtain the recurrence relation for the correlation function 
of the sth order. This relation can be solved by the method of characteristic equations without executing 
item (A similar case takes place for the additive Markov chain.) 

(b) In the opposite case, for m > n + r 2 + . . . + r s _i — N, function K s (r\, . . . , r s -i) is expressed via the 
correlation functions with the sums of their arguments less than N. Some of these functions are of the 
order greater than s. Then we should go to the next item of the algorithm. 

3. All correlation functions with the sum of arguments less than N should be found from a set of linear equations. 
To this end we write Eq. ffiljl for every such correlation function. After executing the "collating" procedure we 
obtain the set of (2 JV_1 — l) linear equations for (2 N ~ 1 — l) sought values of the correlation functions. 

In some particular cases, it is convenient to define K s (-) in Eq. ^ and P{-\-) in Eq. l(i8ll using an arbitrary fixed 
value a (for example, a — 1/2) instead of the average a. In this incident every reasoning remain valid provided that 
the value of a is changed to a in Eqs. Ij50t and i'">5t . and K\ — is changed to K\ = a — a. To obtain average a we 
should add Eq. jfiCty. written for K\, to the set of equations in item of the algorithm. Then we arrive at the set of 
2 N ~ 1 linear equations and (2 Ar_1 — l) sought values of the correlation functions and one of the average a. Besides, 
one can use a instead of a in the different physical problems, which are relevant to the Markov chain. For insta nce, 
the energy in the Ising model is more convenient to express in terms or function Ki{r) — (oj — l/2)(a,+ r — 1/2). 

IV. CONCLUSION 

Thus, we have demonstrated two approaches to determining the statistical properties of the binary Markov chains. 
The first of them should be used if the probabilities of A?"- words occurring can be easily found. The correlation functions 
of different orders can be expressed via these probabilities. The examples of these chains is the permutative Markov 
sequences. The second approach allows one to find the correlation functions directly from the recurrence relations 
connecting them with the memory function. In the general case, these relations contain the correlation functions of 
different orders and, hence, they are difficult to solve. In the case of additive chains, this relations are simplified and 
their use helps to find the solutions. 
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